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MEMORANDUM FOR: 


THROUGH 


Deputy Director for Administration 
Deputy Director for Intelligence 
Deputy Director for Operations 
Deputy Director for Science § Technology 
Executive Secretary 


Comptroller^” 1 ^ '977 


SUBJECT 


Resources for Program Evaluation in Fiscal Year 1977 
-- GMB Bulletin 77-8 


1. A report showing and commenting on the CIA resources devoted 
to Program Evaluation is due in the Office of Management and Budget on 
25 April. It is in our interest that the CIA submission show as 
thoroughly and carefully as possible Agency efforts to systematically 
analyze its programs to ascertain the extent that they "have achieved or 
are achieving their objectives, or are producing other significant 
effects...." 

2. A copy of the actual GMB Bulletin is attached; it requires 
some interpretation. Basically, • the data desired is that showing the 
extent that CIA attempts to determine "what has actually occurred as the 
result of past program actions j" plus our efforts to develop evaluation 
methodologies and ensure that these are incorporated into existing and 
future programs. The efforts identified should be intended to assist 
management. 

3. For the purposes of this (MB tasking, program evaluation 
does not include: 

-- evaluation activities which are an intrinsic part of pro- 
gram operations or management; 

-- analyses of the relative cost/benefit of alternative 
approaches to programs that do not yet exist; 

-- the development and operation of management information 
systems ; 

-- the collection of routine data or the preparation of general 
statistics or basic research. 
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4. Under such criteria,. we would assume that, for example, 
approaches to the development of a new technical collection system would 
not be included, but that th^valuation of performance of existing 
systems would be. Special^^Mef forts to monitor the effectiveness of 
particular products would be included when these were expected to be 
used as a basis for new policy and management decisions. Formal studies 
of' the DDO Evaluation and Program Design Staff and others of collection 
projects would be included. The efforts of much of the DDI Center for 
Policy Support is aimed at determining the utility of finished intelli- 
gence. Some of the work of the PDA Center for the Study of Intelligence 
might be included, A portion of the efforts of the Inspections Staff 
ana the Audit Staff deal with program evaluation. The NIOs engage in 
program evaluation when they participate in "FOCUS-type" studies or 
consider the performance of collectors relative to Key Intelligence 
Questions . 

5. The attachment to the 0MB Bulletin shows the prescribed format 
for your input. Please give us a name of a contact person; we will not 
pass that name to 0MB. We propose to provide 0MB with data for each of 
the four Directorates and for the Office of the Director. Qne staff-year 

should be counted for each full-time person who devot es more than fifty 

‘percent of his/her time to program evaluation activities or to monitoring 
such activities by contractors; part-time employees or employees working 
on evaluations less than fifty percent of their time are not to be 
included. A brief narrative description of program evaluation activities 
and of their expected impact is to be included (two or three paragraphs 
per Directorate) . Significant increases or decreases in funding levels 
£or evaluation activities from FY 1977 to BY 1978 are to b e noted and 
major "policy or strategy changes” mentioned. 

6. A two- three page Agency summary narrative will be prepared by 
this office and we welcome your suggestions. The data you provide 
should include activities of your components in support of interagency 
evaluation efforts (e.g. , by the IC Staff) or of evaluation activities 
of other agencies. The Agency overview will note that CIA regularly 
participates in evaluations of Programs under the control of other 
Departments and Agencies . 

7. Your data and narrative are needed by no later than COB 

21 April . We apologize for the tight deadline, But the QMB tasking only 
arrived in the Co mptroller * s Offic e on 12 Apri^^an^t^e CMB deadline is 
Monday, 25 April, my Staff ■■■Rm 3E58), is25X1A 

coordinating this effor^an^n^remains ready to talk further with your 
people regarding the nature and extent of the task. 

25X1A 


Assistant Comptroller 
Requirements § Evaluation 

Attachment : 
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BULLETIN NO. 77-8 i Aoril 4, 1977 

TO THE HEADS OF EXECUTIVE DEPARTMENTS. AND ESTABLISHMENTS 

SUBJECT: Resources for Program Evaluation in Fiscal Year 

1977 


Purpose . This Bulletin provides instructions for the 
submission of information concerning the resources for 
program evaluation provided for in fiscal year 1977. 

2. Background . The Office of Management and Budget has 
determined the need to collect and analyze information on 
the level of Federal expenditures and staffing devoted to 
program evaluation activities. The information requested by 
this Bulletin is vital to an understanding of the magnitude 
of evaluation resources and the ways in which these 
resources contribute to the achievement of national goals, 
agency missions, and program objectives. Moreover, 
increasing concern about the adequacy of data on program 
performance make.s it necessary to assure that accurate 
information can be provided to the Congress and the public 
on the actual level of program evaluation expenditures. 

3. Coverage . These instructions apply to each executive 
department and independent agency with more than 800 
authorized full-time permanent employees. 

4. Definition . For purposes of this Bulletin, program 
evaluation means the formal assessment, through objective 
measurements and systematic analyses, of the manner and 
extent to which Federal programs (or their components) have 
achieved or are achieving their objectives, or are producing 
other _ significant effects of either a desirable or 
undesirable character, in order to assist future policy and 
management decisions. 

a. The following will be considered as Federal program 
evaluation activities for the purpose of this Bulletin: 
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(1) Formal studies, surveys, and data analyses for 
the purpose of determining the effectiveness, efficiency, or 
impact of a national or regional program. 

(2) Systematic assessment of demonstration programs 
or projects which are expected to have major implication for 
programs of national or regional scope; except that 
evaluation activities which are an intrinsic part of the 
program operations or management should not be reported. 

(3) Formal studies, surveys, and data analyses .for 
the purpose of assessing program management processes, 
procedures, intervention techniques, workload distribution, 
or productivity. 

(4) Assessment and development of program designs 
to assure that programs, once operational, can be 
successfully evaluated. 

(5) Design, development, and field testing of new 
program evaluation methodologies. 

(6) Synthesis and further analysis of results 
obtained by several previous program evaluation efforts. 

(7) Collection of initial data to help in 
evaluation design and provide a baseline for subsequent 
evaluations. 

b. The following will not be considered as program 
evaluation activities for the purposes of this Bulletin.’ 

(1) Design, development, and operation of general 
data systems or management information systems. 

(2) Continuing collection of routine data and 
general purpose statistics. 

(3) Analysis of existing or proposed policies where 
no programs yet exist (even though authorized) for purposes 
of appraising the likely costs and effects of feasible 
alternatives. Although such analyses are often called 
"evaluations , u they are prospective in character; whereas 
program evaluation is retrospective, aimed at determining 
what has actually occurred as the result of past program 
actions. 

(4) Basic research and studies intended to increase 
or foster general knowledge oevelopment, but which are not 
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policy and 

maTTagement decisions. 

(5) Routine, day-to-day monitoring of program 
operations which is an intrinsic part of program 
administration. 

c ♦ it is recognized that the present extensive 
variation among Federal agencies and programs will require 
case-by-case judgments to determine the applicability of the 
above ct iteria to agency ’’evaluation" activities. 

^ • Reporting Requirements . Departments and agencies should 
submit a report in accordance with the attached instructions 
and exhibit to OMB, attention: Evaluation and Program 
Implementation Division by April 25, 1977. This is a one- 
tjLme report . ~ ' ~ 

k • Rescission . This Bulletin is rescinded following 
receipt of the April 25, 1977 report. 

7. Inquiries . Inquiries and requests for assistance should 
be directed to the Evaluation and Program Implementation 
Division, Otfice of Management and Budget. (395-4726 or 
395-0642.) 



Bert Lance 
Director 


Attachment 
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INSTRUCTIONS 


presc?S t ^ 0 „f n f ° rmat of attached exhibit^as 


P a ^, e . “ Enter the date of preparation 

v°^ a< :4 “ Enter the name and telephone number of an 
individual who can respond to guestions relative to 
the information provided. 

p art I. RESOURCES SCHEDULE: 


Pfipar.tment/Agency/Bureau - Enter the 
independent agency. In the case of 
enter each bureau or comparable 
which separate evaluation resources 
can be identified, a consolidated 1 
organizational units (if applicable), 
the total department or agency. At 
be left between each line 


agency, 

entry. 


reporting department or 
cabinet departments, 
organizational unit for 
(funds and personnel) 
ine entry for any other 
and a line entry for 
least one space should 


-■■ ta£r - r s ~ Enter the estimated staff-years for full-time 
permanent personnel who devote more than fifty percent of 
their time to the program evaluation activities outlined in 
paragraph 4a of this Bulletin. This includes full-time 
government personnel engaged in monitoring or directing such 
activities by contractors or grantees. 


personnel 


Salaries - Enter the estimated obligations for 
compensation related to the staff-year entry. 

Personnel Benefits - Enter the estimated obligations for 
personnel benefits associated with the salary figure. 

- S /G rants - Enter the estimated obligations to be 
incurred for evaluation contracts or grants, or, in the case 
of multi-purpose agreements, tne oblications for those 
portions of the contracts or grants that are directly 

^‘ e *. u? ro f r ?? evaluation activities described in 
paragraph 4a of this Bulletin. 


O j-he r .exp enses - Enter the total obligations 
otner administrative expenses directly 
performance, commissioning, or oversight of 


estimated for 
related to the 
the activities 


Approved For Release 2002/01/08 : CIA-RDP80-00473A0001 0007001 4-3 



2 


Approved For Release 2002/01/08 : CIA-RDP80-00473A0001 0007001 4-3 

described in paragraph 4a of this Bulletin. "Other 
expenses" would include obligations for travel and 
transportation of persons, transportation of things, rent, 
communications and utilities, printing and reproduction, 
other services (such as ADP services), supplies and 
materials, and equipment. Significant obligations for any 
of these "other expenses" should be briefly identified in 
the narrative. 

Total - Enter the total estimated FY 1977 obligations for 
salaries, personnel benefits, contracts/grants, and other 
expenses. Note : All obligations are to be entered in 

thousands of dollars. 

Part II. NARRATIVE STATEMENT 


A orief explanatory statement should describe in general 
terms the program evaluation activities being undertaken and 
the objectives toward which they are directed. It should 
highlight significant increases or decreases in funding 
levels, from the current fiscal year to FY 1978 and major 
policy or strategy changes expected to occur. Emphasis 
snould • be placed on the expected use of evaluation 
information in the agency resource allocation and other 
decision processes. In most instances, the narrative for 
individual bureaus should be restricted to two or three 
paragraphs and the departmental or agency summary should not 
exceed two pages. 
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EXHIBIT 

Bulletin No. 77-8 

REPORT ON FY 1*7? PROGRAM EVALUATION RESOURCES 
(Dollars in Thousands} 

Date: 


Contact: 


Part I. RESOURCE SCHEDULE 

Personnel 

Staff Years Salaries Benefits 
Depar tme nt/ Age ncy/8ur eau _£FTPj ($) ( $ j 

Department of Government 
(Report breakdown of major 
bureau or other organiza- 
tional unit for cabinet 
departments only} 

PART II. NARRATIVE STATEMENT 


Contracts Other 

Grants Expenses TOTAL 

(jj (?) (?) 
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